导航菜单
首页 >  Azure Maia for the era of AI From silicon to software to  > Nitin Garegrat on LinkedIn: Azure Maia for the era of AI: From silicon to software to systems

Nitin Garegrat on LinkedIn: Azure Maia for the era of AI: From silicon to software to systems

Thanks Reynold and Congratulations on your Azure Maia 100 Custom Silicon.Like this on your Vision for Maia 100...Earlier this year, Microsoft partnered with AMD, Arm, Intel, Meta, NVIDIA and Qualcomm to form the Microscaling Formats (MX) Alliance with the goal of creating and standardizing next-generation 6- and 4-bit data types for AI training and inferencing. Building on years of design space exploration and research at Microsoft, Microscaling technology enables sub 8-bit formats while also enhancing the strength and ease-of-use of existing 8-bit formats such as FP8 and INT8. These advancements also help contribute to broader sustainability goals like reducing the environmental impact of AI technologies as demand continues to grow by improving the energy efficiency of AI in datacenters as well as on many AI endpoints. The Microscaling Formats (MX) Specification v1.0 released through OCP introduces four common data formats (MXFP8, MXFP6, MXFP4, and MXINT8) that are compatible with current AI stacks, support implementation flexibility across both hardware and software, and enable fine-grain Microscaling at the hardware level. Extensive studies from Microsoft’s AI team confirm that MX formats can be easily deployed for many diverse, real-world cases such as language models, computer vision, and recommender systems. MX technology also enables LLM pre-training at 6- and 4-bit precisions without modifications to conventional training recipes. In addition to the initial specification, a whitepaper and emulation libraries have also been published with more details.

相关推荐: